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Abstract 

Purpose: This study analyzes the activities of top Times researchers in 
the field of political sciences with an emphasis on examining the 
ResearchGate network. Methods: The study opted for altmetric 
approach. Two research communities have been surveyed. The 
number of 145 faculty members affiliated to the top 10 universities of 
the Times 2021 in the field of political science was stratified sampling 
randomly. Their Participation in the ResearchGate network was 
examined. For the attendees, the indicators of citations, RG-score, and 
reading indicators were extracted and compared. For the top 15 best 
Times scientific institutes, the RG scores per member and publication 
per member were calculated and compared. Correlation between 
Times Ranking and ResearchGate's indicators was carried out too. For 
data analysis, LibreOfficeCalc, and SPSS22 were exploited. Findings: 
Only 39% of all faculty members belongs to the best Times centers in 
the field of political sciences, and have been seen by registration in the 
ResearchGate network. For 57 registered individuals, there was a 
significant correlation between ResearchGate's indicators with each 
other. But there was no significant relationship between the Times 
rankings and the mentioned indicators, except for the reads (P-value = 
0.018) with a weak reverse correlation (Spearman coefficient= - 
0.314). Furthermore, comparative analysis for the top 15 Times 
institutes had been done from standpoint of RG-Score, too. 
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Originality: The Correlation relationship between Times rank and 
ResearchGate’s indicators in the field of political sciences. In 
addition, the participation of faculty members of the best scientific 
centers in this field has not been studied yet. 


Keywords: Altmetric, RG Score, Reading Indicator, Citations, 
Political Sciences. 
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Introduction 

It has been predicted that ResearchGate, Mendeley, and Academia 
will be used by researchers in the field of librarianship and 
information, as well as quantitative studies in the next 10 years 
(Mansourkiaie, 2019). The traditional scientometric indicators (such 
as ResearchGate, Google Scholar, and Academia) are consistent with 
altmetrics indicators. But at the same time, more research is needed 
(Patti et al, 2017). Altimetric indices cannot completely replace 
scientific measurement and having a high altmetric rank for an article 
means that the article is attractive to more readers, but this does not 
mean that it is of special scientific importance (Memisevic et al, 
2019). Lora, and Nel-Lo Andreu (2020) while reviewing articles in the 
field of tourism, have stated that scientific social networks (such as 
ResearchGate) reflect the impact of research, but the metric indices of 
these networks cannot replace the scientific metrics of researchers 
such as "citations of articles". According to Bardus et al (2020), there 
seems to be a positive correlation between traditional scientometric 
indicators and social network altmetric indices (such as 
ResearchGate), but more detailed studies are needed to make a 
definite statement in this regard. Therefore, how researchers' 
academic analysis with the help of online academic social networks 
such as ResearchGate works, is ambiguous. This article will help 
reduce this ambiguity. 


Problem recognition 

1. To what extent is the influence of researchers from the top Times 
universities on the ResearchGate network in the field of politics and 
international studies? 

2. What is the status of the three indicators of "reading indicators", 
"citations", and "RG Score" among the faculty members of the field of 
political sciences affiliated with the top scientific centers (Times 
Ranking) who have registered on the ResearchGate network? 

3. What is the comparative analysis of the RG score for all disciplines 
(in general) with the RG score in the field of political sciences at the 
top scientific centers (Times ranking)? 

4. What is the comparative analysis of the top scientific institutes of 
the Times, in terms of RG score per member with a profile in the 
ResearchGate network, and also from the standpoint of the number of 
research items (publications) per member? 
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5. How is the significant correlation relationship between the Times 
rankings and the Research Gate network indices (including reading 
indicators, citation, and RG Score) for faculty members in the field of 
political sciences and international studies affiliated with the Times' 
top centers? 

6. How is the Correlation Analysis between ResearchGate Indicators 
(reading indicators, citations, and RG score) with each other in the 
field of political sciences and international studies? 


Literature Review 

Copiello and Bonifaci (2018) have expressed that the ResearchGate 
score is largely dependent on social activity and there is less scientific 
evaluation of research items. 

There is a positive correlation between the number of citations to 
articles in the ResearchGate media and the faculty members of the 
Sharif University of Technology have been seen due to the high rate 
of citation in the Web of Science and Scopus, therefore, the RG score 
is a suitable tool for scientific assessment (Naderbeigi and Isfandyari- 
Moghaddam, 2018). 

Lepori et al (2018), while studying the presence and activity of 
more than 2000 European higher education institutions and more than 
4000 American scientific centers, in the ResearchGate network, found 
that the RG score is more correlated with the "research item" indicator 
(compared to "Citation" indicator). 

A survey study published by Yan and Zhang (2018) on 
researchers with organizational affiliation with 61 scientific research 
centers in the United States, showed that the ResearchGate scores the 
level of activity of scientific and research institutes in a realistic way. 
It can then be considered a tool of scientific measurement. Also, the 
higher the academic level of the institute, the higher the number of 
research copies and the number of citations and the reading rate of the 
ResearchGate media profile, and the number of followers in the 
profile of the affiliated people, but "reading indicators" and 
"followers" are less and fluctuating. 

Meier and Dirk (2018) have stated that social interactions in 
ResearchGate media have a great impact on increase of the RG score. 
In addition, the two researchers have experimentally uploaded several 
articles with a name that does not belong to the author of the article in 
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the media, which has led to an improvement in the score of Research 
Gate (lack of scientific validity of ResearchGate). 

The ResearchGate Score has an ambiguous measurement. Also, 
there is the ability to manipulate data and information in this media, so 
it is not reliable (Costas and Franssen, 2018). 

Johnson et al (2018) have stated that the rating that the 
ResearchGate network gives to researchers is not desirable in terms of 
scientific evaluation, and sometimes invalid data is uploaded to the 
network. 

Tavosi and Naghshineh (2021) have declared that there was a 
significant relationship between the "reading" indicator and "Times 
ranking" in the form of mean inverse correlation (P-value = 0.04, 
Spearman correlation coefficient= -0.6) among the researchers with 
the degrees of associate professors and higher affiliations with best 
Times ranking in the field of computer sciences. 


Methodology 

This research is a kind of application and has been done using the 
altmetric method (social web-based metrics). Two _ research 
communities have been surveyed. One of them was 145 faculty 
members affiliated with the top 10 universities (Times Ranking 2021) 
in the field of political sciences who were stratified by means of 
random sampling. In this way, from each of the top 10 universities in 
the Times, 15 faculty members in the field of political science were 
selected. Except for the MIT University (5" Times Ranking 2021) 
from which 10 members were selected (because there were no 
more).Their Participation in the Research Gate network was 
examined. For the attendees, citations, RG-score, and reading 
indicators were extracted and compared. Correlation analysis between 
Times Ranking and ResearchGate's indicators was also done for the 
registered faculty members in the ResearchGate network. The second 
research population, was the top 15 best Times centers, that the RG 
scores per member and publication per member were calculated and 
compared. 

It is to be noted, that due to the dynamics of the Research Gate 
network, data was collected in a limited time. Data related to the 
activities of 145 faculty members was extracted in 4 days from 10" of 
October to 14th, 2021. Data from the top 15 Times Centers was 
collected on October 28, 2021. 
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Correlation analysis was done by SPSS22. LibreOfficeCalc 
software has been used for drawing figures and _ representing 
numerical processing. 

Also, the names of the top Times institutions are listed in order of 
priority in the appendix of this present article 
(https://www.timeshighereducation.com/world-university-rankings). 


Findings 
For the first research community, 1.e., 145 faculty members affiliated 
with the top 10 universities of the Times 2021 in the field of political 
sciences, figure 1, figure 2, table 1, table 2, table 3, table 4, table 5, 
table 6, table 7 were obtained. Figure 3 compares the RG score in 
general (for all disciplines) with the RG score for the top 10 centers 
(Times rankings) and was drawn in general for second research 
population, i.e., the top 15 best Times scientific institutes, figure 4 was 
obtained. In all Bar charts (figures) of this article, the number of each 
column indicates the Times ranking (See also Appendix of this paper). 
It’s to be noted that figure 4 was drawn for the 15 top scientific 
centers (Times Ranking). But others of the figures and tables were 
drawn based on the faculty members affiliated with the Times Top 10 
Centers in Political Sciences (57 out of 145 that registered in 
ResearchGate). 


Answer to the first research question 

In figure 1, the presence or registration of the political sciences 
researchers affiliated with the Times' top centers on the ResearchGate 
has been measured. 
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= presence in ResearchGate = non-presence in ResearchGate 


Figure.1: Participation of faculty members affiliated with best institutes 
(Times ranking 2021) in the political sciences and international studies 
field 


According to figure 1, only, 57 of 145 faculty members in the field of 
politics and international studies affiliated with the top 10 scientific 
institutes (Times Ranking), registered in the ResearchGate network 
(39% participation). 


Answer to the second research question 

Three indicators of "reads", "citations", and "RG score" among the 
faculty members in the field of political science affiliated with the top 
ten scientific centers (Times Ranking) who have registered on the 
ResearchGate, have been analyzed. 
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Figure.2: RG score, Citations, and Reading indicators of ResearchGate 
network 


Figure 2 shows activities of faculty members of political sciences 
belonging to the 10 best Times scientific institutes (2021), from 
standpoints of RG- score, Citations, and Reading indicators of 
ResearchGate network. The Citations indicator seems to be related to 
the RG score. 


Answer to the third research question 

RG score in general (for all disciplines) has been compared with the 
RG score in the field of political sciences in the top 10 scientific 
centers (Times ranking). 
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Figure.3: RG score in General versus RG score in Political Sciences field 
at the 10 best scientific institutes (Times Ranking) 
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According to figure 3, the California Institute of Technology (4th 
Times ranking under figure 3) was observed as high ranking between 
10 best Times scientific institutes from standpoints of RG Score per 
member in the field of politics and international studies and also in 
general (in all the fields). 


Answer to the fourth research question 
RG score per member and publication per member have been 
analyzed for fifteen top scientific institutes of the Times. 
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Figure.4: Publications and RG-Score per member in the ResearchGate 
profiles of faculty members affiliated with the 15 best Times institutes, 
the digits of each column indicate the Times ranking of the scientific 
centers 


California Institute of Technology (4th Times ranking under figure 4) 
was observed as high ranking between 15 best Times scientific 
institutes from standpoints of RG Score per member, and also the 
number of publications per member. 

In addition, according to figure 4, ETH Zurich university (14th 
Times ranking) had the lowest number of publications per member. 
Furthermore, California scientific center in Berkeley (7th Times 
ranking) appeared as the lowest RG score per member. 


Answer to the fifth research question 

The analysis of the correlation between the three indicators of the 
ResearchGate network was done in pairs with each other (about the 
research community). 
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Table.1: A test to investigate data normality 
Tests of Normality 


Kolmogorov-Smirnov? Shapiro-Wilk 
saistc | at | sg_| siaiio | at | sig. 


RGscore : 57 .200° : 57 


Citations . .000 
Reads . .000 
TimesRanking : .008 





According to table 1, ResearchGate network of Citations, and Reading 
indicators do not have a normal distribution by the Kolmogorov- 
Smirnov test. But RG- Score has a normal distribution (concerning 57 
registered faculty members of the political sciences field, affiliated 
with 10 best Times institutes which have been selected by stratified 
random sampling). 

Correlation analysis, between ResearchGate’s (RG-score, 
Citations and Reading Indicators) and Times ranking has been done. 
Then, table 2, table 3, table 4, were developed. 

These analyses (table 1, ..., table 4) are related to 57 faculty 
members affiliated with the top 10 universities of the Times institutes 
who have registered in the Research Gate network (in the field of 
political sciences). 


Table.2: Correlation Analysis between Times ranking and RG Score 
indicator 
Correlations 


Pp score | times Ranking | 

RGscore Pearson Correlation -.208 
Sig. (2-tailed) 120 
N 


TimesRanking Pearson Correlation 
Sig. (2-tailed) 
N 
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Table 2, has shown that there is no significant relationship between 
Times ranking and RG Score (P-Value=0.120). Pearson test has been 
used because RG Score has a normal distribution. 


Table.3: Correlation Analysis between Times ranking and Citation 
indicator 


Correlations 


pO tations | ties Ranking 


Spearman's rho _—_ Citations Correlation Coefficient 


Sig. (2-tailed) 
N 
TimesRanking Correlation Coefficient 
Sig. (2-tailed) 
N 





According to table 3, there is no significant relationship between 
Times- ranking and the Citation indicator of the ResearchGate 
network (P-Value=0.288). 


Table.4: Correlation Analysis between Times ranking and Reading 
indicator 


Correlations 
Pe  timesarking | Reads _| 
Spearman's rho TimesRanking Correlation Coefficient 1.000 
Sig. (2-tailed) 
N 


Correlation Coefficient 
Sig. (2-tailed) 
N 





*. Correlation is significant at the 0.05 level (2-tailed). 


Table 4 shows that there is a significant relationship between Times 
ranking and RG Score with a weak reverse correlation (P- 
Value=0.018; Spearman coefficient= - 0.314). 
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Answer to the sixth research question 

Correlation analysis between three ResearchGate indicators with each 
others has been done in the field of political sciences (table 5, table 6, 
table 7). 


Table.5: Correlation Analysis between Citations and Reading indicators 
Correlations 


pO tations | Reats_| 


Spearman's rho Citations Correlation Coefficient 1.000 


Sig. (2-tailed) 

N 

Correlation Coefficient 
Sig. (2-tailed) 

N 





** Correlation is significant at the 0.01 level (2-tailed). 


According to table 5, there is a strong significant relationship between 
Citations and Reading altmetric indicators of the ResearchGate 
network (P-Value=0.000, Correlation Coefficient=0.765). Spearman 
correlation test has been used because Citations, and Reading 
indicators don’t have a normal distribution. 


Table.6: Correlation Analysis between Reading Indicators and RG 
Score 


Correlations 
score | Beats 
Spearman's rho RGscore Correlation Coefficient 1.000 758" 

Sig. (2-tailed) ; .000 

N 57 


Correlation Coefficient 
Sig. (2-tailed) 
N 





** Correlation is significant at the 0.01 level (2-tailed). 
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According to table 6, there is a strong significant relationship between 
RG-Score and Reading altmetrics indicators of the ResearchGate 
network (P-Value=0.000, Correlation Coefficient=0.758). Spearman 
correlation test has been used because Citations, and Reading 
Indicators don’t have a normal distribution. 


Table.7: Correlation Analysis between Citations, and RG Score 
Correlations 


pO score | citations | 


Spearman's rho RGscore Correlation Coefficient 1.000 


Sig. (2-tailed) 
N 
Citations Correlation Coefficient 
Sig. (2-tailed) 
N 





**_ Correlation is significant at the 0.01 level (2-tailed). 


According to table 7, there is a strong significant relationship between 
RG- Score, and Citations altmetric indicators of the ResearchGate 
network (P-Value=0.000, Correlation Coefficient=0.732). Spearman 
correlation test has been used because Citations and Reading 
Indicators don’t have a normal distribution. 


Conclusion 

In the present study no significant relationship was observed between 
the academic Times rankings and some ResearchGate network 
indicators. Except the Reading Indicator for which a weak reverse 
correlation was observed. This is perhaps so _ because the 
ResearchGate guide page (Help Center, retrieved on November 6, 
2021) has stated that calculating the reading indicator is not dependent 
on member registration and that anyone outside this mentioned 
network can read the researchers' files. This mentioned finding is in 
the same direction as one study done by Tavosi and Naghshineh 
(2021). 

It seems that Times Ranking (as a scientific scale), and RG score 
are not aligned with each other as it has been pointed out in other 
studies. For example, O'Brien (2019) has stated that the data or 
scientific papers in the ResearchGate network have significant legal 
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challenges, and also there is no transparency in awarding RG scores to 
the participating researchers. 

According to Masic (2019) only less than 50% of researchers' 
activity is reflected in social networks such as ResearchGate and 
Google Scholar. The present study also approves of this, because only 
39% of faculty members in the field of politics and international 
studies affiliated with best Times’s institute, participated in the 
ResearchGate network. Also, in this regard, Kowalska-Chrzanowska 
and Krysinski (2020) found that although 60% of Polish researchers 
are present in at least one of the research social media ResearchGate, 
or the academy, or Google Scholar, the other 40% are in none of the 
media. 

Ortiz-Torres and Viamonte-Garrido have stated the altmetric 
indicators on ResearchGate and Google Academic are insufficient to 
generalize scientific leaders (influential people in science). In the 
present study, also it is observed that the best scientific centers of the 
Times’ institute are not active in the ResearchGate network. 

The current study has been conducted in the field of political 
sciences and presumably other results involving the relationship 
between the Times ranking and ResearchGate indicators may be 
obtained in other areas. 
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Appendix 

Best scientific institutes based on world Times ranking in order of 
priority (2021) 

. University of Oxford 

. Stanford University 

. Harvard University 

. California Institute of Technology 
Massachusetts Institute of Technology (MIT) 
. University of Cambridge 

. University of California, Berkeley 

. Yale University 

. Princeton University 

10. The University of Chicago 

11. Imperial College London 

12. Johns Hopkins University 

13. University of Pennsylvania 

14. ETH Zurich 

15. University of California, Los Angeles 
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